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Abstract 

Background: Although numerous evidence-based and feasible interventions are available to treat pain from 
childhood vaccine injections, evidence indicates that children are not benefitting from this knowledge. Unrelieved 
vaccination pain puts children at risk for significant long-term harms including the development of needle fears 
and subsequent health care avoidance behaviours. Parents report that while they want to mitigate vaccination pain 
in their children, they lack knowledge about how to do so. An evidence-based clinical practice guideline for 
managing vaccination pain was recently developed in order to address this knowledge-to-care gap. Educational 
tools (pamphlet and video) for parents were included to facilitate knowledge transfer at the point of care. The 
objectives of this study were to evaluate usability and effectiveness in terms of knowledge acquisition from the 
pamphlet and video in parents of newly born infants. 

Methods: Mixed methods design. Following heuristic usability evaluation of the pamphlet and video, parents of 
newborn infants reviewed revised versions of both tools and participated in individual and group interviews and 
individual knowledge testing. The knowledge test comprised of 10 true/false questions about the effectiveness of 
various pain management interventions, and was administered at three time points: at baseline, after review of the 
pamphlet, and after review of the video. 

Results: Three overarching themes were identified from the interviews regarding usability of these educational 
tools: receptivity to learning, accessibility to information, and validity of information. Parents' performance on the 
knowledge test improved (p<0.001) from the baseline phase to after review of the pamphlet, and again from the 
pamphlet review phase to after review of the video. 

Conclusions: Using a robust testing process, we demonstrated usability and conceptual knowledge acquisition 
from a parent-directed educational pamphlet and video about management of vaccination pain. Future studies are 
planned to determine the impact of these educational tools when introduced in clinical settings on parent 
behaviors during infant vaccinations. 

Keywords: Vaccination, Pain management, Infant/child, Health information, Knowledge translation, Implementation, 
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Background 

Routine childhood immunization is a proven tool for 
eradicating and controlling infectious diseases. Despite its 
key role in maintaining global public health, numerous 
individuals either refuse or delay immunization [1,2]. One 
of the well-documented barriers to immunization is pain 
from the requisite needle puncture or 'shot.' [3] There are 
several ways in which injection pain leads to non- 
compliance. First, either parents or health care providers 
withhold vaccination in children to avert child suffering 
[3,4]. Second, children refuse vaccinations themselves. 
Third, negative experiences with vaccination pain in child- 
hood lead to development of life-long needle fears and 
associated health care avoidance behaviours in adulthood, 
including immunization non-compliance [3]. 

It is estimated that one-quarter of adults are afraid of 
needles [5]; vaccine non-compliance occurs in upwards of 
two-thirds of them [5]. Outbreaks of vaccine-preventable 
diseases have been documented to begin in individuals that 
refused immunization [1] or, due to reduced herd immun- 
ity, among infants too young to be immunized [2]. Thus, 
the success of immunization programs is compromised, in 
part, because pain induces avoidance of immunization and 
sub-optimal coverage rates [6] . 

Numerous evidence-based and feasible interventions are 
available to mitigate childhood vaccination pain [7-9]; 
however, there is low uptake of these interventions in clin- 
ical practice, subjecting children to unnecessary pain and 
suffering and the risk of long-term harms, including 
immunization non-compliance [10]. Thus, a knowledge-to 
-care gap exists between what is known about vaccination 
pain management and what is being done to manage pain 
during childhood vaccine injections in clinical practice. 

According to the Knowledge-to-Action Framework [11], 
for scientific evidence to be adopted in clinical practice, 
best-practice guidelines and educational tools are needed. 
We convened an inter-disciplinary panel from across 
Canada in 2008 called the Help ELiminate Pain in KIDS 
(HELPinKIDS) Team in order to address this issue [12]. 
Using the Knowledge-to-Action Framework [11], the 
HELPinKIDS Team developed a clinical practice guideline 
(CPG). Published scientific literature, key informant inter- 
views and discussions with panel members and stake- 
holder partners, including parents, were used to develop 
recommendations for 18 pain-relieving interventions [12]. 

Educational tools (pamphlet and video) directed to 
parents were developed in collaboration with www. 
aboutkidshealth.ca [The Hospital for Sick Children 
(SickKids), Toronto, Canada], the primary health infor- 
mation website dedicated to pediatrics, in order to facili- 
tate the adoption of world evidence-based practices at 
the point of care [13]. Parents were identified as the pri- 
mary targets for education because they are responsible 
for all aspects of their children's care and must acquire 



the necessary knowledge and skills to optimally care for 
their children [14]. In previous studies and in stake- 
holder meetings convened by the HELPinKIDS Team, 
parents reported a knowledge gap in their education 
about effective vaccination pain management and a 
strong desire to learn about ways to reduce pain during 
their children's vaccinations [10]. In addition, they 
reported that this knowledge gap is the major reason for 
under-utilization of pain-relieving strategies during their 
children's vaccine injections [15]. Previous research also 
demonstrates that when pain-relief is provided to chil- 
dren undergoing vaccine injections, parents experience 
higher levels of satisfaction with the medical encounter 
[16]. Teaching and empowering parents therefore has 
the potential to lead to significant improvements in 
current pain management practices, vaccine compliance, 
and health outcomes for children. 

The original educational tools developed by HELPin- 
KIDS included information about evidence-based inter- 
vention options for children of all ages. An important step 
in translating research evidence into practice involves 
adaptation of the knowledge tools to the context of use 
through an iterative process of obtaining feedback from 
the different intended end-users and modifying the tool 
according to their emerging needs [11]. In this study, we 
continued the process of customizing the educational 
tools to better suit the needs of intended users. We tar- 
geted parents of newborn infants in a hospital setting 
shortly after birth and used a robust testing process to 
evaluate: 1) usability of the tools and 2) changes in par- 
ents' uptake of knowledge about evidence-based pain- 
relieving interventions. 

Methods 

Study design 

We employed a mixed methods design. The qualitative 
component consisted of a usability testing process that 
was divided into two steps: 1) heuristic usability evalu- 
ation of the HELPinKIDS educational tools by a human 
factors engineer, and 2) three sets of individual and 
group interviews with parents to validate and improve 
the usability of the tools. The quantitative component 
addressed the effectiveness of the tools, and consisted of 
an independently completed survey of the quality with 
which information is provided in the educational tools, 
and an independently completed test of parents' know- 
ledge about evidence-based pain-relieving interventions. 

Participants and setting 

Mothers and fathers present on the postnatal ward 
(Mother and Baby Unit, Mount Sinai Hospital, MSH) 
after the delivery of a newborn infant were eligible for 
participation. Excluded were parents with infants that 
were born: (1) < 37 weeks gestation (preterm), (2) with 
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major congenital or chromosomal anomalies, (3) admit- 
ted to the neonatal intensive care unit, or (4) scheduled 
for early discharge (within 6 hours of birth). In addition, 
we excluded mothers with significant psychiatric condi- 
tions and parents that were unable to communicate in 
English, as identified by the charge nurse. A purposeful 
sample was taken to ensure a broad representation in 
terms of age, and prior experience with vaccine injec- 
tions in children. Ethical approval was obtained from the 
Mount Sinai Hospital Research Ethics Board and all par- 
ticipants signed a written consent form. 

Development and review of educational tools 

The original pamphlet developed with the HELPinKIDS 
CPG consisted of a 2-sided full page sheet describing 
pain-relieving interventions for use in children of all 
ages undergoing vaccine injections [12]. It contained 
coloured pictures on the front side and coloured pic- 
tures and written instructions on the reverse side. The 
video was a 20-minute documentary film that included 
an overview of the importance of managing vaccination 
pain and video vignettes of children of different ages 
undergoing vaccine injections with and without anal- 
gesic interventions. 

Before gathering input from potential end-users (i.e., new 
parents) to improve the usability of the tools, a 
human factors engineer first conducted a heuristic 
(usability) evaluation of both materials to determine if 
design elements followed established principles for 
user interface design [17]. User requirements were 
identified and translated into tool design features 
aimed at ensuring that they met performance and 
end-user goals/needs. 

Feedback from this evaluation was incorporated into the 
development of the version of the pamphlet and video 
subsequently provided to parents. For the pamphlet, feed- 
back from the human factors engineer led to the following 
changes: separating information for infants (< 12 months) 
and children (> 12 months), ordering interventions 
according to timing prior to vaccine injection (i.e., provid- 
ing a timeline for each intervention), and removing and 
revising some of the images and text. For the video, 
changes included: reducing the duration to 9 minutes; 
substituting general information about immunization with 
specific information about pain management interven- 
tions, including visual displays about how to implement 
individual pain-relieving interventions (e.g., how to apply 
topical anaesthetics); and restricting the information to 
young children. 

Study participants reviewed information on the pamphlet 
for infants < 12 months only. The pamphlet was revised 
after each of the three rounds of interviews in order ad- 
dress comments made by parents. No changes were made 
to the video throughout the study. 



Study procedures 

Three sets of interviews were conducted with parents, 
involving a total of 8 to 21 parents in each. Parents were 
recruited from the postnatal ward of the hospital after 
the birth of an infant (and before any vaccinations had 
been administered to infants) by a member of the re- 
search staff that was not involved in their medical care. 
Interviews were conducted either individually or in 
groups, in the ward classroom or in parent private 
rooms, according to parent preferences. Each interview 
was divided into three phases: baseline, pamphlet review, 
and video review. The baseline phase included general 
questions regarding parents' knowledge and attitudes 
about childhood vaccination pain. The pamphlet and 
video phases included review and feedback of the tools 
by parents. An experienced moderator (EL) facilitated 
discussion using a semi-structured interview guide: 

• What do you know about this topic? 

• What do you want to know about this topic? 

• What information do health care providers believe 
parents need to know? 

• What should parents need to know and be able to 
do after REVIEWING this material? 

• When should parents get this information? 

• Where should parents see this information? 

• Ask about specific details regarding layout, 
understandability, attractiveness, content. 

• Additional comments? 

and audio-recorded the discourse. When mothers and 
fathers both participated, they were interviewed together, 
but were able and encouraged to provide individual 
comments. Parents completed a demographic form at 
the end of the interview. 

The quantitative component consisted of administra- 
tion of a validated instrument for assessing the health in- 
formation (Calgary Health Region Evaluation of Health 
Information, CHREHI) [18], and a knowledge test specif- 
ically developed for this study. The CHREHI instrument 
includes questions about understandability and adequacy 
of information and was administered after review of the 
pamphlet and video. The knowledge test includes 10 
true/false questions about the effectiveness of various 
interventions for reducing vaccine injection pain and 
was administered at baseline, after presentation of the 
pamphlet, and after presentation of the video (Table 1). 
Parents rated their level of confidence in their 
responses to each question using a 5-point Likert 
scale (very sure, a little sure, neither sure/nor unsure, 
a little unsure, very unsure). Finally, parents were 
asked about their intention to use the techniques 
included in the pamphlet and video to lessen their 
baby's pain from vaccine injections using a 5-point 
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Table 1 Knowledge test for vaccination pain 
management in infants 

Correct 
response* 

1. Giving sugar water can reduce pain and distress. True 

2. Using medicines like acetaminophen (Tylenol, False 
Tempra), 

or ibuprofen (Advil, Motrin) can reduce pain and 
distress. 

3. Putting ice on the skin can reduce pain and False 
distress. 

4. Breastfeeding can reduce pain and distress. True 

5. Bottle feeding can reduce pain and distress. True 

6. Holding the baby can reduce pain and distress. True 

7. Using numbing (anaesthetic) medicines can True 
reduce 

pain and distress. 

8. Distracting the baby can reduce pain and distress. True 

9. Acting calm can reduce pain and distress. True 

10. Rubbing the skin can reduce pain and distress. False 
* Based on HELPinKIDS clinical practice guideline [12]. 

Likert scale (very unlikely, unlikely, neither unlikely 
nor likely/neutral, likely, very likely). 

Data analysis 

Interview recordings were transcribed verbatim and ana- 
lysed using content analysis [19]. Data collection and 
analysis occurred simultaneously until saturation of the 
key emerging themes occurred. The frequency and 
consistency in which participants indicated categories of 
responses in the transcripts was used to provide credibil- 
ity to these categories. Inter-coder reliability between the 
2 coders (EL and AJ) was assessed using Kappa statistics 
(in NVivo 8), and any disagreements (considered as < 
90% agreement) were resolved by the 2 coders achieving 
consensus. 

The baseline mean number of correct responses on 
the knowledge test was compared to post-pamphlet and 
post-video scores using repeated measures ANOVA. 
Analyses were repeated including interview group ses- 
sion (1, 2, 3) and parent (mother, father) as covariates in 
the model. The statistical program SPSS version 20 was 
used. A p-value < 0.05 was considered significant. 

The qualitative component of the study adheres to the 
RATS guidelines on qualitative research (http://www. 
biomedcentral.com/ifora/rats). 

Results 

The study was conducted between July 7, 2011 and No- 
vember 2, 2011. Altogether, 33 mothers of newborn 
infants (some accompanied by their partners) were 
approached to participate. Seven mothers declined due 
to being fatigued; however, in 2 instances, the father 



agreed to participate. In 9 instances, both mothers and 
fathers participated. Thus, 26 mothers and 11 fathers were 
included (total sample size = 37). Demographic character- 
istics of the participants are displayed in Table 2. 

Qualitative analysis for usability testing 

Overall, three overarching themes related to the tools were 
identified in the interviews: 1) receptivity to learning, 2) 
accessibility to information, and 3) validity of information. 

Receptivity to learning 

Parents were overwhelmingly receptive and open to 
learn about the pain management strategies they could 
use for their infants during vaccine injections: 

"You know, it's distressing especially before any kind of 
injection, you know, and yeah, I think anything like 
this would help. Any kind of information would help. " 

"I think everyone should get this and give. . . it would 
[he] very useful to me and all the mothers going home. " 

Accessibility to tools 

Parents wanted access to the educational tools. They 
specified various settings for the information, including 
hospital, health care provider's office, and the internet: 

"I would have found it useful if I had this before, you 
know, even in a package that I got from [the hospital]." 

"I think that if they have it more in education classes 
or your new mom's classes. " 

"Definitely at the pediatrician's office. . .while you're 
there, while you are waiting in the waiting room, you 
know? You know the secretary can you know definitely 
hand this out. Have this there. It would be useful 
because you are waiting anyways. " 

"I think it would be handy if it's on the internet." 

Parents preferred to have the pamphlet and video to- 
gether rather than one or the other: 

Table 2 Characteristics of Parents (n=37) 

Mean (SD) or 
Frequency (%) 

Age 33 (4) 

Mothers 26 (70) 

Prior experience with childhood vaccine injections 18 (49) 

University education 22 (60) 
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"They complement each other, like they go hand in 
hand. Like you read the pamphlet and then you 
actually saw it in action in the video. " 

"[The video] was very helpful. Especially when they 
show us how to like apply the anesthetic. That's 
something that I learned. And then you actually see 
what you have written here you actually see it done in 
practice. So it was easier, it made it more easier for me 
to understand and appreciate this. " 

Validity of information 

Parents reported that credibility of the information was 
important to them. Some parents indicated they could 
trust the information based on the perceived credibility 
of its source: 

"I do trust the information because I mean I see 
SickKids as an authority on children's health so when I 
saw that I feel more comfortable with this. " 

Some parents compared the information with prior ex- 
perience and external information sources (e.g., doctor 
or nurse): 

"Um, most of the suggestions, most of them I've heard 
before so they weren't a surprise. I wasn't sure about 
every answer that I've heard that it's good to give your 
child. . ." 

"Avoiding the acetaminophen. . . not been proven to 
reduce pain at the injection but it could help 
afterwards to relieve the pain post [injection], cause 
that's what my family doctor always tells me to give 
them [acetaminophen[ after they have their injections." 

In addition, some parents reported they would seek 
confirmation that the information is accurate before 
implementing it for vaccine injections: 

"I would probably ask [my doctor], yeah. I would 
probably, you know, say, like I don't think that . . . the 
[acetaminophen] before the injection would be useful. 
Like what do you think? You know, I would probably 
ask for a second opinion/ask for their opinion. " 

Changes to organization and content of the pamphlet 

Parents reported that they were generally satisfied with 
the pamphlet; that it was easy to follow, and clear in 
terms of which methods were effective and ineffective. 
After each set of interviews, iterative changes were made 
to improve the visual and textual information, according 
to the principles of user-centered design. After the first 
set of interviews, the changes made included: 1) 



confining information on one side of the page to reduce 
redundancy and the need to turn the page; 2) re- 
organizing information according to preparatory activ- 
ities that are performed ahead of time and pain-relieving 
activities that are performed on the day of vaccination; 
and 3) adding the SickKids' website address for all of the 
HELPinKIDS resources to improve perceptions of the 
credibility of the information. In order to accommodate 
the changes, some textual explanations were shortened 
or deleted. After the second set of interviews, the follow- 
ing changes were made: 1) the use of colour was reduced 
to minimize perceptions that the pamphlet was clut- 
tered; 2) some words were underlined to bring attention 
to them; and 3) the specific names of commercially 
available topical anesthetic products were included to fa- 
cilitate acquisition by parents. After the third set of focus 
interviews, final edits were made to the pamphlet by 
AboutKidsHealth, and included; improving clarity and 
quality of images, and harmonizing the punctuation 
and writing style (Figure 1). The final version of the 
pamphlet is shown in: http://www.aboutkidshealth.ca/ 
En/Heal thAZ/TestsAndTreatments/GivingMedication/ 
Pages/Pain-Free-Injections. aspx. 

Feedback about the video 

Parents reported they were generally satisfied with the 
content of the video. Specific suggestions for improve- 
ment focused mainly on increasing the speed of presen- 
tation, reducing repetition of concepts, and harmonizing 
phraseology and/or re-ordering content, in order to ad- 
dress perceptions that the video was too long and/or re- 
petitive and that word descriptions and/or the order of 
presentation was inconsistent with the pamphlet. These 
suggestions were used to revise the video. The video is 
available on YouTube channel: http://www.youtube. 
com/watch?v=jxnDc2PxGUc. 

Quantitative analysis - structured feedback and 
conceptual knowledge 

Responses to the CHREHI survey are shown in Table 3. 
The majority of parents reported they understood all of the 
information in the pamphlet and video, and that the amount 
of information was adequate in terms of breadth and depth. 

The knowledge test scores for the baseline, post- 
pamphlet, and post-video phases are shown in Table 4. 
The mean number of correct responses increased from 
baseline to post-pamphlet, and from post-pamphlet to 
post-video; p < 0.001 and p=0.012, respectively. If only 
answers whereby parents reported both the correct re- 
sponse and complete certainty in their level of confi- 
dence regarding their response were included, then the 
score increased significantly between baseline and post- 
pamphlet, and between post-pamphlet and post-video; 
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®The 3 P's of Helping your Baby during Vaccinations 
A Parent's Guide: Babies up to 1 year old 

Vaccine injections can be painful and stressful for babies and parents, but you can really make a difference. 

For your baby's next vaccine injection, plan with your health care provider to: 

1 ) Apply topical anaesthetics to numb the skin - these are medicines you can buy at a pharmacy without a prescription. 

2) Give your baby sugar water for comfort - make sugar water at home or at the clinic by mixing 1 teaspoon of sugar with 
2 teaspoons of water. 

3) Distract your baby - choose an age-appropriate item to bring. 

Read the 3 P's of vaccination pain management below and combine these strategies to improve pain relief . 
For more information and a video, visit the SickKids (The Hospital for Sick Children, Toronto, Canada) website: 
www.aboutkidshealth.ca/pain-free-injections 



STEP l: ©HARMACOLOGICAL (PAIN MEDICINE) 




Apply topical 
anaesthetics 



\ 1 



TOPICAL ANAESTHETICS 



Available products: lidocaine (Maxilene™), tetracaine 
(Ametop™), lidocaine-prilocaine (EM LA™). 
Apply to either the upper outer part of the leg (infants less than 
1 year), or upper arm (infants 1 year old), 30 to 60 minutes 
before injection - check product instructions. 
If 2 or more injections are planned, apply to both legs or arms. 
May cause temporary reddening or whitening of skin - this is normal. If there is a rash, talk to 
your doctor - it could be an allergic reaction. 

Avoid acetaminophen (Tylenol™), ibuprofen (Advil™), ice and cold sprays before injection- they 
have not been proven to reduce injection pain. After injection , acetaminophen or ibuprofen may 
be used to relieve fever or discomfort. 



STEP 2: ©HYSICAL (BODY POSITION AND ACTIVITY) 



SUGAR WATER 


Give sugc 
water 





• Give your baby sugar water 
to drink right before the 
injection. 




too tightly 



HOLD 

Hold your baby close 
during injection - in a 
hug or on your lap. 
This feels good and helps 
your baby stay still. 
Avoid holding your baby 
this can increase pain and distress. 



BREASTFEED 

• Start breastfeeding your baby 
before injection and continue 
during and after injection. 

• If 1 injection is planned, position 
your baby to expose 1 leg; expose 
both legs for 2 or more injections. 

• If the baby cannot be breastfed, offer a bottle or pacifier starting 
before injection and continue during and after injection. 




STEP y. ©SYCHOLOGICAL (THOUGHTS AND BEHAVIOURS) 



BREATHE DEEPLV 



Deep breaths 

' Stay calm and use your normal 
^ speaking voice. This helps your 
rf ^ . \ baby stay calm - babies look to 
\ their parents for how to act and 
L--^ feel. 

^^^^^^^ ■ If you are nervous, take a few 
slow, deep breaths to calm yourself before and during injection 
- breathe so your stomach expands, not your chest. You can do 
this while holding your baby. 



DISTRACT 

• Help keep your baby's 
attention away from the 
injection. 

■ Distractions vou can use : 
rocking, cuddling, singing, 
talking, sucking (breast- 
feeding or pacifier). Distract with objects or toys (bubbles, 
pop-up books, rattles) when your baby is calm enough to 
do so; otherwise, distress can be increased. 




These are scientifically proven ways of reducing pain in babies during vaccine injections. 
Think about what worked and plan ahead to make the next vaccination less painful. 



HELP 

InTids SickKids 

Figure 1 Final version of pamphlet. 



aboutkidshealth 



"Clinical Practice Guideline: Reducing the pain of childhood vaccination: 
an evidence-based clinical practice guideline"- Adapted from, CMAJ 
December 14, 2010 182;E843-E855 by permission of the publisher. 

© 201 0 Canadian Medical Association 



p < 0.001 and p=0.001, respectively. There was no signifi- 
cant effect of either interview group session (1, 2, 3) or 
parent that participated (mother vs. father); p > 0.05 for 
both analyses. 

All parents reported they intended to act on the infor- 
mation included in the pamphlet and the video, with 
over 80% indicating they were 'very likely' to do so. 

Discussion 

Over three decades of research has led to the discovery 
of numerous evidence-based and feasible treatments 
for the management of pain during childhood vaccine 



injections [7-9]. Despite this evidence, few children are 
benefitting from this scientific knowledge [10,15]. The 
practice of performing vaccine injections in children 
without analgesia is associated with significant harms, 
including the development of life-long needle fears and 
immunization non-compliance [3]. As part of the first 
step in addressing this important knowledge-to-care gap, 
we developed a CPG and educational tools for parents to 
present research knowledge in a clear, concise, and user- 
friendly format. [12] According to the Knowledge-to-Ac- 
tion Framework [11], the development of high-quality 
educational tools as an intervention to promote the 
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Table 3 Responses to calgary health region evaluation of health information instrument (n=37) 





Understood all of the information 
in pamphlet (%) 


Adequate information in 
pamphlet (%) 


Understood all of the 
information in video (%) 


Adequate information 
in video (%) 


Frequency, (%) 


29 


29 


32 


30 




(78) 


(78) 


(87) 


(81) 



adoption of the CPG requires the inclusion of research 
evidence as well as customization of the evidence to the 
local context through an iterative process of obtaining 
feedback from potential users and modifying the tools 
according to the emerging needs of end-users. In this 
study, we adapted the educational tools to the needs of 
new parents and evaluated the usability of the tools and 
the uptake of knowledge as a result of the tools. 

The results demonstrated that parents have a keen 
interest in learning about pain-relieving interventions for 
infant vaccinations. They identified a variety of methods 
of dissemination of this education to better reach new par- 
ents, including; parent classes, birthing hospitals, doctor's 
offices, and the internet. In addition, they expressed a pre- 
ference to have access to both the pamphlet and video be- 
cause they viewed them as complimentary. With respect 
to the content of the tools, parents reported that they 
understood the information and it met their needs in 
terms of breadth and depth. Furthermore, parents 
reported that they intended to use the information in the 
pamphlet and video for their infant's vaccine injections. 

These findings are consistent with previous studies 
demonstrating that parents are concerned about a child's 
pain during vaccinations [20] and that they have a strong 
desire to mitigate vaccination pain [10,15]. Therefore, the 
current practice of under-treating pain during routine 
childhood vaccinations cannot be attributed to parent ap- 
athy about pain. The major barrier to routine pain man- 
agement, as identified by parents themselves, is a lack of 
knowledge about evidence-based interventions [10,15]. 

In addition, significant improvement in parent knowledge 
about pain management strategies and in confidence level 
in knowledge occurred after exposure to the educational 
tools. Parents were largely uncertain about evidence-based 
pain management options prior to reviewing the educa- 
tional tools. There was an increase of 250% in the number 
of responses to the knowledge test that were both correct 
and whereby parents were completely sure, with significant 
increases occurring between the baseline and post-pamphlet 



phases and also between the post-pamphlet and post-video 
phases. Importantly, evaluation of parent knowledge uptake 
considered not only correct responses but also level of cer- 
tainty in responses, as individuals would not be expected to 
act on their knowledge unless they are confident in it. 

We directed the educational tools to new parents be- 
cause they are the primary stakeholders involved in 
childhood vaccination and because education is rou- 
tinely provided to parents around the time of delivery of 
an infant, thus opportunity exists to incorporate educa- 
tion about vaccine injection pain management within 
current hospital education programs provided to families 
of newborn infants. In addition, teaching new parents 
about pain is the most efficient method of ensuring that 
children will receive consistent pain management over 
time and across all medical settings and for all medical 
procedures encountered, which is key to creating an 
environment that promotes healthy child development 
(i.e., is free from harm). A growing body of literature 
demonstrates the effectiveness of parent training inter- 
ventions for developing skills necessary to promote opti- 
mal infant and child development, including emotional, 
social and cognitive development [21,22]. 

The feedback from stakeholders at our HELPinKIDS' 
meetings, including parents, clinicians, and policy 
makers, suggested: 1) a multi-modal approach for par- 
ent education, and 2) the use of flexible and portable 
education formats. Specifically, written information 
supplemented with pictures and a video with vignettes of 
children undergoing vaccination with the pain-relieving 
interventions promoted by the CPG was deemed as vital 
components of an effective teaching intervention. To this 
end, a pamphlet and video were developed to promote the 
adoption of the CPG. These tools allow for a multitude of 
education formats, including; self-administered, group- 
based or individually- administered [23]. The results from 
our previous qualitative and quantitative studies con- 
ducted in the same setting and population informed deci- 
sions regarding the content and presentation of the 



Table 4 Parent knowledge test scores (n=37) 





Baseline 


After pamphlet 


After video 


P-value (baseline to pamphlet)* 


P-value (pamphlet to video)* 


Correct 


5.4 (1.7) 


8.1 (1.2) 


8.5 (0.8) 


< 0.001 


0.012 


Correct & Sure 


2.0 (1.9) 


6.1 (2.1) 


7.2 (1.6) 


< 0.001 


0.001 



Values are mean number of correct responses out of 10 (standard deviation, SD). 
* RM ANOVA. 
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educational tools [10,15], that is, they were derived from 
the learning needs identified by new parents in this set- 
ting. The findings of the present study verify that both 
tools together are optimal to parent training because: 1) 
parents expressed a preference to have access to both 
tools, and 2) uptake of knowledge was greater when both 
tools were used together. It is important to note that both 
the pamphlet and video focussed on actions parents can 
undertake to reduce pain during their infants' vaccine 
injections and that parents reported that they intended to 
implement the knowledge at future vaccine injections. 

We observed that some knowledge test questions were 
frequently answered incorrectly by parents, even after re- 
view of the pamphlet and video. These questions 
related to the effectiveness of oral analgesics, rubbing 
the skin (i.e., tactile stimulation), applying ice, and bottle- 
feeding. Since information about these interventions was 
not prominent and in some cases was not even included in 
either the pamphlet or video, there was no expectation that 
parents would score perfectly. A priori, a decision was 
made to emphasize effective rather than ineffective or 
unproven pain management strategies and to include ques- 
tions about ineffective strategies to reduce responder bias. 

Although we targeted parents, clinicians constitute im- 
portant knowledge transfer targets for vaccine injection 
pain management. Prior research by our group demon- 
strates that parents seek endorsement by health care provi- 
ders for pain management strategies [10,15]. This notion 
was confirmed in two ways in the present study. Firstly, 
parents reported they planned to consult their doctor about 
the information before using it. Secondly, parents indicated 
that the pamphlet and video should be available in their 
doctor's office. Efforts to improve current pain manage- 
ment practices must therefore also include clinicians to 
support and facilitate parent efforts to mitigate their child 
(ren) s pain. We are currendy conducting parallel studies of 
clinician-directed educational tools in different practice set- 
tings in order to ensure that their needs are being met. 

Although we demonstrated interest and knowledge ac- 
quisition from our educational materials in our study sam- 
ple, the immediate postpartum period may not be the 
optimal time for learning about this information because it 
will not be acted upon by parents until two months later, 
the age of initiation of an infant's primary immunization 
series in many geographical regions. There is also the possi- 
bility that some parents may feel fatigued or overwhelmed 
by the birth of their infant and added responsibilities, and 
therefore not receptive to learning about this information. 
In both cases, however, having the information or knowing 
about how/where to access the information in the fu- 
ture (e.g., internet) may be sufficient as parents can self- 
administer the education when they are ready to learn. 

Strengths of the study include the setting and design. 
First, the study setting, MSH, afforded us with the 



opportunity to recruit parents from a large catchment area 
as it draws patients from the most populated metropolitan 
area in Canada (over 5.7 million inhabitants). This facili- 
tated inclusion of parents with diverse cultural and ethnic 
backgrounds, perspectives and practices. In addition, there 
was ample time for parents to participate in the study 
since they typically stay in hospital for over 24 hours after 
the delivery of an infant. The timing of information was 
synchronized with other educational programs offered to 
new parents, and takes advantage of their information- 
seeking needs and motivation for learning. Finally, both 
parents were included, rather than mothers alone. 

Second, the study design included an in-depth explor- 
ation of the usability of the educational tools and objective 
measures of knowledge uptake derived from them. The 
qualitative component included robust usability testing 
process, which consisted of a heuristic evaluation and inter- 
views with end-users (i.e., parents) to validate and improve 
the material based on usability principles. The involvement 
of the end-users (i.e., parents) in this process improves the 
probability that it will lead to subsequent changes in behav- 
ior [11]. The quantitative component included evaluation 
of parent knowledge about effective pain-relieving inter- 
ventions. Demonstrating knowledge acquisition ensures 
that the educational tools are sufficiently effective for diffu- 
sion of knowledge in the relevant user group [11]. 

Conclusions 

We found that an educational pamphlet and video about 
infant vaccine injection pain management were welcomed 
by new parents and improved knowledge about evidence- 
based pain-relieving interventions. We are now planning 
studies to evaluate knowledge use from the educational 
tools, including: utilization of pain-relieving interventions 
during infant vaccination and whether this results in 
reduced infant pain experience; and parent and health care 
provider satisfaction with the immunization experience. 
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